5 



3-D Measurements of Improved Accuracy 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention, in general, relates to a method of improving the accuracy of 
10 optical three-dimensional measuring methods and, more particularly, to a 
method of this kind utilizing a matrix camera for generating an image. 

2. The Prior Art. 

Such cameras are equipped with image recording matrices which are 
15 capable of detecting the intensity distribution of an image in a pixel-wise manner 
and of emitting it as a matrix. They may be exemplified by CCD sensors and 
CMOS sensors provided in cameras. An individual element of the image 
recording matrix is called pixel. The position of the pixels of an image recording 
matrix will hereinafter be referred to as a "pixel site", the pixel site being 
20 represented by the position of the center of the pixel. 

Calculation of the three-dimensional data of an object on the basis of 
digital images thereof is performed by known methods of stereophotogrammetry 
by sub-pixel interpolation. Such a method has been described in German patent 

specification DE 196 23 172 CI (=U.S ). Sub-pixel interpolation is the 

25 calculation of the precise position of a dot based on the values of neighboring 
pixels. The sub-pixel position is more precise than the pixel raster. 4 (2x2), 9 
(3x3), 16 (4x4) of more pixels may be used for the sub-pixel formulation. 

In an ideal image recording matrix the pixel sites are arranged in an ideal 
pixel raster of constant raster width. The pixel sites of such an ideal image 
30 recording matrix are ideal pixel sites; their position Is called "desired position". 
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For purposes of taking into consideration fabrication-inherent deviations of 
the actual pixel raster from an ideal pixel raster it is known to take measurements 
of a reference measure. For instance, the distance between two points may be 
measured by defining the centers of the two points. For the definition of each 
5 center several pixels will become involved. In this manner, a possible error may 
be averaged out. The mean distance between the pixels may thus be defined 
with great accuracy since the overall error remains unchanged and the relative 
error becomes smaller at a corresponding number of pixels. 

Such deviations of the actual pixel raster are usually taken into 
10 consideration during calibration of a three-dimensional measuring system 
(Luhmann, T.: Nahbereichsphotogrammetrie; Wichmann Verlag, Heidelberg). 

Comparative tests with high-resolution three-dimensional measuring 
systems have shown that 3-D data obtained by two identically configured 3-D 
measuring systems, the image recording matrices of which come from the same 
15 fabrication series, always display slight deviations which cannot be traced to 
known effects such as non-unifomn photo sensitivity or dark signals of the image 
recording matrix. 

It has been found that the accuracy of optical three-dimensional 
measuring systems which for generating an image utilize at least one matrix 
20 camera with an image recording matrix whose raster width of the pixel raster is 
known, is improved by measuring, for all pixels or a selected part:ial number of 
pixels of the image recording matrix, the individual deviation of the pixel site 
relative to the desired position of the pixel site in the pixel raster, by determining 
the exact individual pixel sites on the basis thereof and by taking these exact 
25 pixel sites into consideration when calculating the 3-D data. 

While it is possible to define the individual deviation of the pixel site 
relative to the desired position of the pixel site by scanning the image recording 
matrix by a laser, the expense and complexity of laser scanning equipment for 
scanning an image recording matrix are unacceptably high. 

30 
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OBJECTS OF THE INVENTION 

It is an object of the Invention, for defining deviations from the desired 
position of the pixel sites of pixels of at least one image recording matrix to make 
use of the method proposed in co-pending U.S. patent application No.:., filed on 
5 even date herewith (Attorney Docket 010501) wherein the image recording 
matrix becomes a component of an optical 3-D measuring system at least while 
the method is being practiced. 

SUMMARY OF THE INVENTION. 
10 In the accomplishment of this and other objects the invention provides a 

method comprising the steps of: 

a) making available an object which is suitable for measuring by the optical 
3-D measuring system, the object being planar or of such curvature that 
during smoothing according to step c) only local errors in the 3-D data are 
15 averaged out without altering the contours of the object; 

(Local errors are understood to be such en-ors as statistical 
uncertainty. This error excludes itself from the global error in 
particular, i.e. the absolute error of the measured 3-D coordinates 
relative to the world coordinate system.) 
20 b) measuring the object by the 3-D measuring system for determining 3-D 
data of the object; 

c) thereafter smoothing the determined 3-D data; 

d) projecting back to the sensors of the at least one matrix camera all 3-D 
measurement points of the object by use of the 3-D data determined in 

25 step b) as well as those smoothed in step c); 

e) determining the difference between the position of the two points 
associated with a 3-D measuring point and projected back to the sensors; 

f) thereafter optionally shifting or not shifting between object and optical 3-D 
measuring system; 

30 g) repeating steps b) through f) until the desired exactness of the deviations 
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of the pixel site of the pixels of an image recording matrix to be 
deterniined by the method has been attained, the exactness being a 
function of the number of repetitions and number of shifts of step f); and 
h) defining the deviation of the pixel site of the pixels from the desired 
5 position on the basis of the values for each pixel or selected pixels 

determined in step e). 

It is possible by the method in accordance with the invention while 
defining the 3-D data of the measured object to take into consideration those 
deviations of the pixel site of an image recording matrix which could not be 
10 considered by calibration of the 3-D measuring system, in this manner, the 
accuracy of the 3-D data may be improved. 

Other objects will in part appear hereinafter and will in part be obvious. 

DESCRIPTION OF THE DRAWING. 

15 The novel features which are considered to be characteristic of the 

invention are set forth with particularity in the appended claims. The invention 
itself, however, in respect of its structure, construction and lay-out as well as 
manufacturing techniques, together with other objects and advantages thereof, 
will be best understood from the following description of preferred embodiments 

20 when read in connection with the appended drawing which depicts the effect of 
an error of the pixel site of a camera on the result of a measurement, 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The optical 3-D measuring method exemplarily chosen in connection with 
25 an embodiment is the method described in German patent application No.: 

DE 196 23 172 (= US ). However, practicing the method of the invention 

makes it possible to modify other optical 3-D measuring methods for yielding 
improved accuracy. 

Measuring points defined by this 3-D measuring method will suffer from 
30 errors as a result of erroneous pixel sites. Fig. 1 is a view from the direction of 
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the Y axis to an XZ plane. Accordingly, only one error of the pixel site is 
illustrated in the X or Z direction of this world coordinate system. Analogous 
connections will result for a view from the X direction to the YZ plane. 
In German patent application DE 196 23 172 (=US....) grey value 

5 sequences from two cameras are correlated with each other. This involves a 
search for corresponding points. The criterion for two corresponding points is a 
maximum correlation between two grey value sequences. The grey values for a 
predetermined point at a certain position in the image recording matrix are 
defined by sub-pixel interpolation. 

10 If exact pixel sites are not available the described method of sub-pixel 

interpolation will yield an enror. 

In order to compensate the measurement error resulting from the error at 
the pixel site the equations for the sub-pixel interpolation will be modified such 
that the exact pixel site is also taken into consideration. In this manner the 

15 source of the error caused by the error of the pixel sites is eliminated. 

The exact individual pixel sites may, for instance, be defined by a laser 
scanning process or by the method in accordance with copending application 
No.:.... (Attorney Docket 010501) described supra. In this connection, it is 
important that the object used for detecting the exact pixel sites be a planar 

20 object or an object of such curvature in which by smoothing the detected 3-D 
data of the object only the errors of the 3-D data are averaged out without 
altering the contours of the object. 
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